Searching PAJ 



1/2 s<— v 



PATENT ABSTRACTS OF JAPAN 



(1 1 )Publication number : 2002-1 40700 

(43)Date of publication of application : 17.05.2002 



(51)tnt.CI. 



606T 1/00 
H04N 1/60 
H04N 1/46 
H04N 9/68 
// H04N101:00 



(21) Application number : 2000-336394 

(22) Date of filing : 02.1 1 .2000 



(71 Applicant : KEIOGUUKU 
(72)Inventor : NAKAJIMA MASATO 
ANDO SHINGO 
IMAI SATOKO 



m 



i is 
WML 



1 



!*.V.. .. 



* ft: 



(54) METHOD AND DEVICE FOR PROCESSING COLOR IMAGE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To automatically reduce 
information volume disappearing at the time of 
outputting color picture data generated by an electronic 
image pickup device to a monitor or a printer. 
SOLUTION: A color image processor is provided with a 
color type conversion means 3 for generating a lightness 
image of hue/saturation/lightness space regulated by a 
cylindrical coordinate system from a primary color image, 
an area division means 6 for analyzing the texture of the 
lightness image and dividing the lightness image into 
plural areas on the basis of the analytical result, a 
density conversion curve preparation means 7 for 
preparing the density conversion curve of the lightness 
image by smoothing the histogram of each divided area, 
a density conversion means 8 for converting the density 
of the lightness image by using the density conversion 
curve, and a color type reverse conversion means 5 for 
generating a primary color image by using the lightness 
image whose density is converted. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The step which generates the lightness image of the hue / saturation / lightness space 
standardized by the cylindrical coordinate system from a color primary color image, The step 
which analyzes the texture of said lightness image and divides said lightness image into two or 
more fields based on said analysis result, The color picture art characterized by having the step 
which performs concentration conversion of said lightness image by graduating said divided 
histogram for every field, and the step which generates a color primary color image for said 
concentration conversion using a carrier beam lightness image. 

[Claim 2] The color picture art according to claim 1 characterized by defining the 1st clip value 
which creates the gray level histogram for said every field, and determines the degree of 
smoothing of said histogram based on the dispersion condition of the concentration of each field 
when graduating said histogram. 

[Claim 3] The color picture art according to claim 2 which is characterized by defining said 1st 
clip value using the complexity of the texture of each field in addition to the dispersion condition 
of the concentration of each field. 

[Claim 4] The color picture art according to claim 2 characterized by combining with said 1st clip 
value the 2nd clip value which the degree of histogram smoothing of each field is weakened 
[ 2nd 1 and changes the brightness of the whole field to homogeneity, and using it 
[Claim 5] A means to generate the lightness image of the hue / saturation / lightness space 
standardized by the cylindrical coordinate system from a color primary color image, A means to 
analyze the texture of said lightness image and to divide said lightness image into two or more 
fields based on said analysis result, The color picture processor characterized by having a means 
to perform concentration conversion of said lightness image by graduating said divided histogram 
for every field, and a means to generate a color primary color image for said concentration 
conversion using a carrier beam lightness image. 



[Translation done.] 



http://www4.ipdl Jnpitgojp/cgi-bin/tra^ 2007/09/27 



JP,2002-140700,A [DETAILED DESCRIPTION] 1/8 
* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach and equipment which improve 
especially a dynamic range about the suitable color picture art and suitable processors for an 
electronic image pickup device, such as a video camera and a digital camera. 
[0002] 

[Description of the Prior Art] If the face of the scene, for example, the person who used the 
aperture as the back indoors, in which a very bright part and a very dark part are intermingled is 
picturized with an electronic image pickup device, and the image is displayed on a monitor or is 
outputted by the printer, a very bright part will skip, or a very dark part will be crushed, and the 
phenomenon in which the details information which must have been acquired is no longer 
reproduced will occur in the image sensor of an electronic image pickup device. This originates in 
the dynamic range of image output units, such as a monitor and a printer, being narrower than 
the dynamic range of the image outputted from an electronic image pickup device. 
[0003] Various approaches are proposed in order to reduce disappearance of the above details 
information conventionally. For example, the average luminance of each block is computed by 
dividing an input image into the block of the shape of two or more tetragonal lattice, and the 
gradation compensator and the gradation amendment approach of image pick-up equipment 
which were divided based on this average luminance of having been made to perform gradation 
amendment for every field are indicated by patent No. 2951909. 

[0004] However, it sets to the above-mentioned patent No. 2951909. The texture A from which 
brightness changes stair-like within limits with brightness width of face narrow in order to 
perform field division of an input image based on the average luminance of a block as shown in 
drawing 19 (a) When the texture B from which brightness changes stair-like within limits with 
wide brightness width of face as shown in this drawing (b) adjoins, it is considered that both are 
the same fields and gradation amendment is performed using the same gradation correction 
curve. For this reason, there was a possibility that the very bright part of Texture B may skip 
when said gradation correction curve is set up the the best for Texture A, or a very dark part 
might be crushed. Moreover, when said gradation correction curve was set up the the best for 
Texture B, there was a possibility that a stair-like brightness change of Texture A might no 
longer be reproduced. 

[0005] Then, the artificer of this invention etc. divided the input image into two or more fields 
previously, is the dynamic range automatic compression approach of performing different 
concentration transform processing for every field of the, and analyzed the texture of an input 
image, and the dynamic range automatic compression approach characterized by determining 
said field based on the analysis result was proposed (Heisei 1 1 patent application No. 333205). 
According to this dynamic range automatic compression approach, as compared with the 
conventional approach, it is effective in the ability to reduce disappearance of useful information. 

[0006] 

[Problem(s) to be Solved by the Invention] This invention offers the approach and equipment for 
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applying the automatic compression approach of the above-mentioned dynamic range to a color 

picture. 

[0007] 

[Means for Solving the Problem] The step to which the color picture art concerning this 
invention generates the lightness image of the hue / saturation / lightness space standardized 
by the cylindrical coordinate system from a color primary color image, The step which analyzes 
the texture of said lightness image and divides said lightness image into two or more fields based 
on said analysis result, It is characterized by having the step which performs concentration 
conversion of said lightness image, and the step which generates a color primary color image for 
said concentration conversion using a carrier beam lightness image by graduating said divided 
histogram for every field. By this configuration, comparable improvement processing is 
simultaneously attained also to a saturation value by performing dynamic range improvement 
processing to a lightness value. 

[0008] Moreover, when graduating said histogram, the gray level histogram for said every field is 
created, and it is characterized by defining the 1st clip value which determines the degree of 
smoothing of said histogram based on the dispersion condition of the concentration of each field. 
By this configuration, even if a concentration part with high frequency is in a gray level 
histogram, too much contrast stretching can be prevented. 

[0009] Furthermore, in addition to the dispersion condition of the concentration of each field, it 
is characterized by defining said 1st clip value using the complexity of the texture of each field. 
By this configuration, the superfluous contrast stretching processing to the field containing a 
body with few concentration differences can be prevented. 

[0010] And it is characterized by combining with said 1st clip value the 2nd clip value which the 
degree of histogram smoothing of each field is weakened [ 2nd ], and changes the brightness of 
the whole field to homogeneity, and using it By this configuration, the degree of contrast 
stretching can be weakened and it can be made the brightness homogeneity of the whole field. 
[0011] Moreover, a means by which the color picture processor of this invention generates the 
lightness image standardized by the cylindrical coordinate system from a color primary color 
image, A means to analyze the texture of said lightness image and to divide said lightness image 
into two or more fields based on said analysis result, It is characterized by having a means to 
perform concentration conversion of said lightness image, and a means to generate a color 
primary color image for said concentration conversion using a carrier beam lightness image by 
graduating said divided histogram for every field. Thus, by constituting, comparable improvement 
processing is simultaneously attained also to a saturation value by performing dynamic range 
improvement processing to a lightness value. 
[0012] 

[Embodiment of the Invention] Hereafter, it explains to a detail, referring to a drawing about the 
gestalt of operation of this invention. 

[0013] (Gestalt of the 1st operation) Drawing 1 is the block diagram showing the configuration of 
the 1 st of the image pick-up equipment of the gestalt of operation of this invention, and drawing 
2 is flow drawing showing the outline of the flow of the processing in the image pick-up 
equipment. 

[0014] As shown in drawing 1 , image pick-up equipment 1 is equipped with the image pick-up 
means 2, the color formal conversion means 3, the dynamic range improvement processing 
section 4, and the color formal inverse transformation means 5. 

[0015] The image pick-up means 2 is equipped with semi-conductor image sensors, such as 
CCD, picturizes a photographic subject, generates the primary color color picture information on 
RGB, and outputs it to the color formal conversion means 3. 

[0016] The color formal conversion means 3 changes RGB primary color color picture 
information into the image information of the HSI space which consists of the hue (H:hue) and 
saturation (S:saturation) which are called a color appearance system, and lightness (Irintensity), 
as shown in step S1 of drawing 2 . 

[0017] The model which matches RGB space and HSI space performs conversion according 
[ various **** ] to a congruence hexagon-head drill color model here. The concept of a 
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congruence hexagon-head drill color model is explained using drawing 3 . (a) of this drawing 
shows setting out of the lightness shaft in RGB space, (b) shows the situation of the projection 
to a vertical field to a lightness shaft, and (c) shows the HSI space of the congruence hexagon- 
head drill after the projection. 

[0018] In each pixel of a color picture, a HSI value is computed by using the above-mentioned 
congruence hexagon-head drill color model from a RGB value. Lightness information (lightness 
value) expresses the component of the brightness of a color picture, and is in agreement with 
the monochrome image information generated from color picture information. 
[0019] And with the gestalt of operation of the 1st of this invention, as shown in drawing 4 , the 
HSI space which standardized the congruence hexagon-head drill color model by the cylindrical 
coordinate system is adopted, and it uses for RGB->HSI conversion and HSI->RGB conversion. 
Hereafter, an example of the algorithm of RGB->HSI conversion and HSI->RGB conversion is 
explained. 

[0020] Considering the cube which touches three shafts, in a RGB rectangular coordinate 
system, R, G, B, and its complementary color C, M, and Y are in physical relationship as shown in 
drawing 3 (a). The lightness shaft I is set as the main pair square axis of this RGB cube, the 
black of 1= 0 and the top-most vertices of another side are made into the white of 1= 1 for one 
top-most vertices, and it is I=[(max{R, G, B}+ (it is defined as min{R, G, B}]/2.)). 
[0021] Here, if parallel projection of the RGB cube is carried out to the flat surface which 
intersects perpendicularly with an I-axis, a forward hexagon as shown in drawing 3 (b) will be 
formed. On the other hand, Hue H and saturation S are defined like drawing 3 (c) on the flat 
surface which intersects perpendicularly with an I-axis. Hereafter, the conversion approach is 
shown. However, the range of R, G, B, S, and I shall be [0, 1], and H shall have the value of [0, 
2pi]. 

[0022] [1] A degree type defines RGB->HSI conversion **** and I. 
1= (Imax+Imin)/2 [0023] however, Imax = — max [R, G, B} 
Imin =min{R,G,B} 

[0024] i) Imax =Imin It solves and is an S=0H= indeterminate [0025]. ii) Imax !=Imin It solves and 
S is defined as follows. 

At the time of I<=0.5: S=(lmax-Imin)/(Imax+Imin) 

At the time of I>0.5: S=(Imax-Imin)/(2-Imax+Imin) 

[0026] Next, r, g, and b are defined as follows. 

r=(Imax -R)/(Imax -Imin ) 

g=(Imax -G)/(Imax -Imin ) 

b=(Imax -B)/(Imax -Imin ) 

[0027] Finally H is defined as follows. 

R=Imax At the time: H=pi/3 (b-g) 

G=Imax At the time: H=pi/3 (2+r-b) 

B=Imax At the time: H=pi/3 (4+g-r) 

[0028] [2] HSI->RGB conversion ****, M1, and M2 It asks as follows. 
At the time of I<=0.5: M2 =1- (1+S) 

At the time of I>0.5: M2 =I+S-I-SM1 =2 I-M2 [0029] i) It is R=G=B=1[0030] at the time of S= 0. 
ii) At the time of S!=0, as **:processing #1 h=H+(2/3) pi, processing #2 mentioned later are 
performed and R is defined as follows using the acquired value X. 

R=X [0031] Processing #2 later mentioned as h=H are performed, and G is defined as follows 
using the acquired value X. 

G=X [0032] As h~H-(2/3) pi, processing #2 mentioned later are performed and B is defined as 
follows using the acquired value X. 

B=X [0033] ** : — processing #2 — first — ha It sets as follows. 

It is :ha =h-2pi [0034] at the time of :ha =h+2pih>2pi at the time of ha =hh<0. Next, ha X is 
defined as follows with a value. 

It is X=M1+ (M2-M1) and ha/(pi/3) at the time of ha <pi/3. 

[0035] (pi/3) It is X=M2 [0036] at the time of <=ha <pi. Pi<=ha It is X=M1+(M2-M1) - (4/3) (pi- 
ha /(pi/3)) at the time of <(4/3) pi. 
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[0037] (4/3) Pi<=ha It is X=M1 [0038] at the time of <2pi. Thus, if the HSI space standardized by 
the cylindrical coordinate system is used, comparable amendment will be simultaneously attained 
also to saturation information (saturation value) only by compressing a dynamic range to 
lightness information. This point is explained using drawing 5 . Drawing 5 is drawing showing the 
response relation of the flat surface and congruence hexagon-head drill color model which pass 
along the I-axis and S shaft of the HSI space standardized by the cylindrical coordinate system, 
the HSI space standardized by the cylindrical coordinate system as shown in this drawing — 
setting — a lightness value — 11 from — 12 if concentration conversion is carried out, at the 
same time it will carry out a lightness value change in a congruence hexagon-head drill color 
model — a saturation value — S1 from — S2 It is changed. 

[0039] Lightness value li which is the output of the color formal conversion means 3 It is 
inputted into the dynamic range improvement processing section 4. The dynamic range 
improvement processing section 4 is the lightness value li, as shown in step S2 of drawing 2 . It 
receives and predetermined dynamic range improvement processing is performed. 
[0040] As shown in drawing 1 , the dynamic range improvement processing section 4 consists of 
a field division means 6, a concentration conversion curvilinear creation means 7, and a 
concentration conversion means 8. And as shown in drawing 6 , the concentration conversion 
curvilinear creation means 7 consists of the gray-level-histogram creation means 11, the 
entropy calculation means 12, the edge degree calculation means 13, the contrast actuation clip 
value decision means 14, the concentration shift actuation clip value decision means 15, a 1st 
clipping means 16, a 2nd clipping means 17, and an accumulation histogram creation means 18. 
[0041] The field division means 6 performs field division and spatial quantization of a field 
boundary to the inputted lightness image as shown in steps S21-S22 of drawing 7 . First, at step 
S21, the texture of an input image is analyzed and an input image is divided into two or more 
fields based on this analysis result. LOG shown in the following formula [1] with the gestalt of 
operation of the 1st of this invention (Laplacian Of Gaussian) The filtering processing which 
calculates a filter in an input image has determined the field. The result of having carried out 
field division of the image shown in drawing 8 (a) is shown in drawing 8 (b). 
[0042] 
[Equation 1] 

[0043] Here, it differs from the result of the field division by the texture analysis, and the result 
which human being looked at the same image and did field division manually in many cases. 
Therefore, if the result of the field division by the above-mentioned texture analysis is used as it 
is, the part from which it differs as a result of both will be sensed unnatural for human beings 
eyes. 

[0044] So, with the gestalt of operation of the 1st of this invention, in the following step S22, and 
some resolution is quantized for the result of the above-mentioned field division analyzed per 
pixel. As shown in drawing 8 (c), an input image is divided into a square block and, specifically, it 
determines whether to have responded to the pulse duty factor of a field and to belong to the 
field of a gap about the square block applicable to the result of the field division shown in this 
drawing (b), and the boundary of superposition and a field. Thereby, the result of the field division 
shown in drawing 8 (b) is quantized as shown in this drawing (d). 

[0045] The image data spatially quantized with the field division means 6 is inputted into the 
gray-level-histogram creation means 1 1 within the concentration conversion curvilinear creation 
means 7. With the grayHevel-histogram creation means 1 1, as shown in step S23 of drawing 7 , a 
gray level histogram is created for every field. 

[0046] With the concentration conversion curvilinear creation means 7, fundamentally, a gray 
level histogram is created for every field, then, an accumulation histogram is created for every 
field, and concentration conversion is performed using the accumulation histogram. However, 
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only by this primitive operation, since the value of an accumulation histogram changes rapidly in 
a concentration part with the high frequency of a gray level histogram when the accumulation 
- ; histogram shown in this drawing (b) is created from the gray level histogram shown, for example 
in drawing 9 (a) and it carries out concentration conversion of the input concentration liO at the 
output concentration Io0, contrast will be emphasized too much. 
s [0047] So, with the gestalt of operation of the 1st of this invention, too much contrast stretching 
is prevented by introducing the 1st clip value. That is, as shown in drawing 10 (a), the 1st clip 
value CL is set up to a gray level histogram, and the part above the 1st clip value CL is clipped 
and taken out. And as shown in drawing 10 (b), total is equalized and the part which carried out 
[ above-mentioned ] the clip is arranged to the original gray-level-histogram down side. That is, 
the average value of total of the histogram of the part beyond the 1st clip value CL is the bias 
value of a gray level histogram. Curve A1 of drawing 10 (c) It is the accumulation histogram 
created from the gray level histogram before clipping, and is a curve A2. It is the accumulation 
histogram created from the gray level histogram after a clip. The abrupt change of the value of 
an accumulation histogram is lost by clipping so that clearly from the comparison of two curves. 
Therefore, the situation where contrast is emphasized too much is prevented. When the 1st clip 
value CL is large, the degree of smoothing of a gray level histogram is large here, and when the 
1st clip value CL is small, the degree of smoothing of a gray level histogram is small. 
[0048] Here, the need of already graduating a gray level histogram in order [ that dispersion in 
the concentration value of a gray level histogram is large / to which details information cannot 
disappear easily even if it will output with the narrow image output unit of a dynamic range about 
the large field of a dynamic range, if it puts in another way ] to show in drawing 1 1 (a) is small. 
Since a possibility that details information may disappear is large on the other hand when 
dispersion in the concentration value of a gray level histogram as shown in drawing 1 1 (b) 
outputs with the narrow image output unit of a dynamic range about the narrow field of a 
dynamic range small, it is necessary to graduate a gray level histogram and to open a dynamic 
range. 

[0049] So, with the gestalt of operation of the 1st of this invention, the dispersion condition of 
the concentration value of a gray level histogram is searched for for every field, and the clip 
value CL which influences the degree of smoothing of a gray level histogram is determined 
according to this dispersion condition. The entropy calculation means 12 computes Entropy H 
using following formula [2], and, specifically, the 1st clip value CL is calculated using the property 
shown in drawing 1 1 (c). 
[0050] 
[Equation 2] 

E = Z{-p(n)logp(n)} -xt [2] 

p(n> : mmrwmimm 

[0051] Superfluous processing may be performed if the clip value which is the degree of 
smoothing of a histogram is determined only in the dispersion condition of the concentration 
value of a gray level histogram at this time in the case of empty or a field like Shirakabe which 
contains a body with few concentration differences in the whole from the first. So, with the 
gestalt of operation of the 1st of this invention, the complexity of a texture is considered and a 
clip value is re-determined. 

[0052] The edge extract result acquired by the operation with the LOG filter proposed as a way 
method of the field division here as an index which shows the complexity of theque CHISUCHA 
is used. If a sigma value (space constant) performs filtering processing which calculates the LOG 
filter of two kinds of size in an image, the edge extract image which changes with magnitude of 
the sigma value will be acquired. As a result, an example is shown in drawing 1 2 . The field 
surrounded by the thick wire of an upper right portion in (a) of this drawing and (b) shows empty. 
About the part which human being sees and does not have a concentration difference, the 
difference in the number of edges of the image in that field has little empty etc. irrespective of 
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r * the size of a sigma value so that clearly from this drawing. Then, this description is adopted as a 

value showing the complexity of a texture, the following formulas [3] re-determine a clip value, 
- _ and the degree of smoothing is made small about the small field of the difference in the number 

of edges. 

[0053] 

[Equation 3] 



[0054] It sets at this ceremony and is CLold. The clip value and CLnew which were determined 
only based on the dispersion condition of the concentration in a field The clip value and 
edgesmall which were determined newly, and edgelarge A sigma value is the number of edges in 
smallness and an adult field, respectively. Here, it is computed by the edge degree calculation 
means 13, and edgesmall and edgelarge are CLnew. It is computed by the contrast actuation clip 
value decision means 14. And a clip is performed by the 1st clipping means 16. 
[0055] Since smoothing of a histogram which was explained above and which is performed for 
every field is the technique of the contrast stretching in an image processing originally, it may 
induce an unnatural result depending on the class of the texture. Human being s skin is raised as 
an example. When it applies to a color picture especially, the difference of the color becomes 
remarkable and a result in which ** and others is conspicuous is brought So, with the gestalt of 
operation of the 1 st of this invention, in order to prevent disappearance of the information which 
weakens the degree of smoothing of a histogram, i.e., the degree of contrast stretching, and is 
produced in the case of an output, the 2nd clip value is introduced as the technique of 
performing brightness amendment of a field. 

[0056] The 2nd clip value is set to the lower part of a gray level histogram. As shown in drawing 
13 (a), it sets to all the concentration values of a gray level histogram, and it is the 2nd clip value 
CL 2. The following parts are removed and the total is added to the frequency of the minimum 
concentration value (0) or the maximum concentration value (255). In addition, drawing 13 (b) 
showed the case where it added to the minimum concentration value. And using the gray level 
histogram clipped in this way, an accumulation histogram is created and let what normalized it be 
a concentration conversion curve. Curvilinear A3 of drawing 13 (c) It is the accumulation 
histogram created from the gray level histogram before clipping, and is curvilinear A4. It is the 
accumulation histogram created from the gray level histogram after a clip. The result of the 
degree of contrast stretching having become weaker and having changed to the brightness 
homogeneity of the whole field can be obtained by introducing the 2nd clip value so that the 
configuration of this concentration conversion curve may show. Here, the 2nd clip value is 
determined by the concentration shift actuation clip value decision means 15, and a clip is 
performed by the 2nd clipping means 17. It is suitable for the 2nd clip value to give the 1st clip 
value and proportionality. 

[0057] And an accumulation histogram is created by the accumulation histogram creation means 
18 using the gray level histogram clipped with the 1st clipping means 16 and the 2nd clipping 
means 17. The actuation from the entropy calculation means 12 explained above to the 1st 
clipping means 16 and the 2nd clipping means 17 corresponds to step S24 of drawing 7 , and 
actuation of the accumulation histogram creation means 18 corresponds to step S25. 
[0058] The concentration conversion curve created with the accumulation histogram creation 
means 18 is outputted to the concentration conversion means 8. The concentration conversion 
means 8 performs concentration conversion of each pixel in a field by making a different 
accumulation histogram for every field into a concentration conversion curve, as shown in step 
S26. However, in order to make it the boundary of a field not become discontinuous, the 
following linear interpolation processings are performed about each pixel within the square block 
applicable to a boundary. 

[0059] Block B1 with which this pixel belongs the concentration value of an attention pixel as 
shown in drawing 14 (a) And three nearby block B-2s, B3, and B4 Concentration conversion is 




[3] 
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carried out using each concentration conversion curve, and it is the concentration value gl after 
conversion, g2, g3, and g4. It obtains. Next, based on the following formula [4], the concentration 
value g after linear interpolation (x y) is computed. That is, said concentration value g1, g2, g3, 
and g4 According to the distance to an attention pixel, weighting is carried out from the core of 
four blocks B1, B-2, B3, and B4. 
[0060] 
[Equation 4] 



9(x,y)= S^Pi^ 9, + "T 92 J 



g3+-pg4j [4] 

[0061] The lightness image information Io1 which was outputted from the concentration 
conversion means 8 and to which concentration transform processing was performed is inputted 
into the color formal inverse transformation means 5. The color formal inverse transformation 
means 5 generates the RGB primary color color picture information that the dynamic range has 
been improved, using said lightness image information Io1, the hue information H which is the 
output of the color formal conversion means 3, and the saturation information S, as shown in 
step S4 of drawing 2 . This color picture information is inputted into the printer and monitor 
which are not illustrated, and is printed or displayed. 

[0062] (Gestalt of the 2nd operation) When the gestalt of operation of the 2nd of this invention 
brings a lightness value close to the level of the center of the lightness range, it is the 
description to open the dynamic range of saturation and to raise the visibility of an image. 
[0063] Drawing 1 5 is the block diagram showing the configuration of the 2nd of the image pick- 
up equipment of the gestalt of operation of this invention, and drawing 16 is flow drawing showing 
the outline of the flow of the processing in the image pick-up equipment. In these drawings, the 
sign same identically to drawing 1 or drawing 2 as the sign used for the corresponding 
component in those drawings was attached. 

[0064] As the gestalt of operation of the 2nd of this invention shows to drawing 15 , and the 
saturation emphasis processing section 21 and a selector 22 are formed and it is shown in step 
S3 of drawing 16 , it is the description to perform lightness information processing for saturation 
information amendment, and other configurations and actuation are the same as the gestalt of 
operation of the 1st of this invention mentioned above. 

[0065] The lightness information processing for saturation information amendment adds the 
following processings to a lightness value, in order to open the dynamic range of the vividness 
information on a color. Processing for which a lightness value is moved in the direction where 
the dynamic range of a saturation value becomes larger is performed, so that it is separated 
from the I-axis in the cylindrical coordinate system of drawing 4 when the saturation value has a 
certain amount of magnitude that is,. By this processing, when a saturation value is to some 
extent large, the vividness of a color can raise the visibility of an image by becoming more 
intelligible. Here, it is the direction which brings a lightness value close to one half of maximums 
(it is 128 when the range of a lightness value is 0-255) as the approach the dynamic range of a 
saturation value becomes larger as shown in drawing 17 . Specifically, in the case of [< 1 28, in 
the case of I>=128, a lightness value is computed [ with the saturation information processing 
section 21 ] by the following formula [6] to each pixel with the following formula [5] again. 
[0066] 

lo2=Ii+ (Sxdelta max) — Formula [5] 
[0067] 

Io2=Ii— (Sxdelta max) — Formula [6] 

[0068] Setting at these ceremony, Io2 is a lightness value after migration, and li. The original 
lightness value and S are a saturation value and deltamax. It is migration maximum. Therefore, a 
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formula [5] and [6] are migration maximum deltamax to the saturation value S with the value of 
0-1. After multiplying, it adds, when the original lightness value is smaller than 128, and when 
large, it means lengthening. An example in [< 128 was shown in drawing 18 . 
[0069] The formula [5] or the lightness value Io2 of [6] computed in the saturation emphasis 
processing section 21 is inputted into a selector 22 with the lightness value Io1 which the same 
t processing as the gestalt of the 1st operation was performed by the dynamic range improvement 
processing section 4, and was outputted. And it is adopted as a lightness value Io3 whose way 
more near 128 is the pixel, and is inputted into the color formal inverse transformation means 5. 
[0070] Thus, according to the gestalt of operation of the 2nd of this invention, in addition to the 
effectiveness of the gestalt of the 1st operation, when a saturation value is to some extent 
large, the visibility of an image can be raised by becoming more intelligible about the vividness of 
a color. 

[0071] In addition, this invention is not limited to the gestalt of the operation explained above, 
and various deformation is possible for it For example, in the gestalt of implementation of the 
above 1st, in order to shorten the time amount which the above-mentioned RGB->HSI 
conversion and HS[->RG conversion take, you may process like following the (1) - (3). 
[0072] (1) Compute the lightness value I from a RGB value, and save a RGB value 
simultaneously. 

(2) Perform dynamic range improvement processing to a lightness value. 

[0073] A RGB color picture is re-computed based on the RGB value saved by (3) and (1). That 
is, it is different not to compute saturation information and hue information. The color picture 
data after processing are the same as the gestalt of the 1st operation. 
[0074] 

[Effect of the Invention] As explained to the detail above, according to the color picture art and 
processor of this invention, comparable improvement processing is simultaneously attained also 
to a saturation value by performing dynamic range improvement processing to the lightness value 
of the hue / saturation / lightness space standardized by the cylindrical coordinate system. 
[0075] Moreover, even if a concentration part with high frequency is in a gray level histogram by 
introducing the 1st clip value according to the color picture art of this invention, too much 
contrast stretching can be prevented. 

[0076] Furthermore, according to the color picture art of this invention, the superfluous contrast 
stretching processing to the field containing a body with few concentration differences can be 
prevented by considering the complexity of the texture of each field and determining the 1st clip 
value. 

[0077] And according to the color picture art of this invention, by introducing the 2nd clip value, 
the degree of contrast stretching can be weakened and it can be made the brightness 
homogeneity of the whole field. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram showing the configuration of the 1st of the image pick-up 
equipment of the gestalt of operation of this invention, 

[Drawing 2] Flow drawing showing the outline of the flow of the color picture processing in the 
image pick-up equipment of drawing 1 , 

[Drawing 3] Drawing for explaining a congruence hexagon-head drill color model, 

[Drawing 4] Drawing for explaining the HSI space standardized by the cylindrical coordinate 

system, 

[Drawing 5] Drawing showing the response relation of the HSI space and the congruence 

hexagon-head drill color model which were standardized by the cylindrical coordinate system, 

[Drawing 6] The block diagram showing the configuration of the concentration conversion 

curvilinear creation means in the image pick-up equipment of drawing 1 , 

[Drawing 7] Flow drawing showing the outline of the flow of processing of the dynamic range 

improvement processing section in the image pick-up equipment of drawing 1 , 

[ Drawing 8] Drawing for explaining actuation of the field division means in the dynamic range 

improvement processing section of drawing 1 , 

[Drawing 9] Drawing for explaining smoothing of a histogram, 

[Drawing 10] Drawing for explaining the 1st clip value, 

[Drawing 1 1] Drawing for explaining the decision approach of the 1st clip value, 

[Drawing 12] Drawing showing the example of acquisition of the edge extract image with which 

sigma values differ, 

[Drawing 13] Drawing for explaining the 2nd clip value, 

[Drawing 14] Drawing for explaining the linear interpolation approach in a concentration 
conversion means, 

[Drawing 15] The block diagram showing the configuration of the 2nd of the image pick-up 
equipment of the gestalt of operation of this invention, 

[Drawing 16] Flow drawing showing the outline of the flow of the color picture processing in the 
image pick-up equipment of drawing 15 , 

[Drawing 17] Drawing for explaining the lightness information processing for the saturation 
information amendment in the image pick-up equipment of drawing 1 5 , 

[Drawing 18] Drawing for explaining how to realize lightness information processing of drawing 
11 , 

[Drawing 19] It is drawing for explaining an approach for the conventional gradation amendment. 
[Description of Notations] 

3 Color Formal Conversion Means 

4 Dynamic Range Improvement Processing Section 

5 Color Formal Inverse Transformation Means 

6 Field Division Means 

7 Concentration Conversion Curvilinear Creation Means 

8 Concentration Conversion Means 
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(b) £*-f*afc* l>^5.MSffe*3;h,, ATJiSS I 

igglcn^hy^ h»$tlttS 

[0 0 4 7] *«W©»l©HJS©»«T?f±, 10 

SSI©* 'J yZf*$.*MXlrZ>Z. ttM^ny h 
-f&fc>*>, 010 (a) lC^1-<t 

TJfcOUtf-. ^LT, HI 10 (b) ic^1-J;5tC, ±IS 
* U y:/Lfc»#&ttft«r¥*&{lsU 7t©3ggt* h* 

7A©/^7^fi!iotV^„ 010 (c) ©AlllA 

, y y7"^ft?i©Mt^ ^7A^f,MLfc 20 

©* y yyitCL^/h^VNt, »St^ ^yAOfift 

[0 0 4 8] iC-e. 01 1 (a) tZTF-f-J: 5 ft, gEtC 30 

fttfyV-tS y7 uy^OJ^V^^I-oVTIi. y*-f 
$ y* l^S?©|JEVMIfcWaS«m&LTt>» fflSMff 

&Stttt/h$v\, 111 1 (b) K*+J:5 4, » 

^^yv ! ©*^^p^^tti^BTtH7^1-5t, «p«istt«^ 
fcUT^'f y* 5i£J»H^*>S 0 40 

to 0 4 9] ^ec-e, **w©*ioie(fi©»tt-?f4, 

SWcfeWgSfc* hy*7A©jggffi©tfibo£ ; fl:l§-£* 

C©ff(bO#J:-g-|CJStT, $gt7. hy* 7 A©5p 

ffjlcti, 3i>hof-J|a^g!!i2*STflBOSC [2] 
^T^Vhnf-Htr^HJU, 011 (c) fcjjrtfctt 
£ffl^-Cf51©y y y^|ta4:*»5. 

[0 0 5 0] 

[ft 2) 
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E = i{-p(n)logp(n)} -3 [2] 
p(n) : ^SnCDm^JS 

[0 0 5 11 -©£#, ^Si©J:3^ 7c*£#lc 
A©»«ffi©ffe>o#*^-©*-Ct^ hy*?A©¥»fc 

JBftTfi, r^^^^©^$t$^pi*L-C^ y y7°ffi£ 

[0 0 5 2] TtT-X^TOmmZZTrrtyimkLX. 

LTS*Lfc LOG 7 4 

^©^S^^rEl 1 2I^1" 0 C©0© (a) , (b) (C 

£©Bj&>&« 5 fc. $4 if. AW**aT«SI6 

©SSV^^KBULTtt, a|t©*/Mi*»«»t>e>-f. ^© 
$WJ©PHfe©^y S?»©Slfttt:4>ftv\ ^Cf, C© 
#**t^*^Y©^$ L-TSfliU fiHT 

©^ [3] \Z.£Q9V yTHft&fffcfcU x r ;S«D| 

So 

[0 0 5 3] 

[00 54] i <Dt£\Z}5^X, CUu f±!B*£f*l©#g© 

L<ft^Lit7 y y7°ffi. edge„u ,edgei„„ fi 

t\ edge..!, v edge,„„ ^ y v^-g-ff ttt3MS:13 

\z£*>mm$tl> CL„„ liay hy* h«fls*y yT'fi 
**¥Sl4tJ:DlHaSix5. LT, iHyyfy 
i/^&ieKJ:^ ^ y y^Uff^ttSo 
[00 5 5] Lfc, ffl«S»CtTtoiv5 t^h^ 

7 A©¥^btt7c*iii^^S(cSo{t ^ a > h 7 * h ?SH 
©^jfe-CfeSfcJf), ^©x^T.^-ywSSlcio-Cfi^f 
eaf*<S**4&^i:^*>5. «i U-CAMOflHASfclf 
€>*t*. #7-iHg>lcigfflLfcJ§3\ -t©fe©^ 

BJ©» 1 ©HlS©^ffi-T?(i, t ^ h^7A©¥ift©I 
<o =>>- h7^ h^Sirog^-v^SS*. A^-offl 
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[0 0 5 6] 3S2©* V y:/iHi»Sfc;* h^7A©T 
»MR££;Jl5. Ell 3 (a) izm-TXo^, «gt* 

2 J^T©gB#£©y£y , *®Jfta*ft/NMM[ (o) 
t>L<tt**»ftffi (2 5 5) ©«glc£ b£fr-fr3 0 

013 (b) ttSW«IIHc£ Lftfrtffc»ft«: 
*tfc„ *lt, £©£?,;:* y yy^fciglt^ h 

mUct©&8Sf»tt5„ 013 (c) ©ft 
HA, tt* y y7*rfT5t&©»*fc* h^7Ai>f,M 10 

5o C©«**|fcft*0»*W»fo^d»6J:5l^ !&2© 
^y y^ffi**A1-5wi:lcJ:«J. ay h?* h»WI© 

®2^ y y tr^^ai7icj;9 ^ y yy^n^ns. 

5 0 20 
[0 0 5 7] -t b"C v #»fc* h**7-M&S#&18fc,fc 
t»» Hi * y ytr^^gkl6*iJ:t«|52^ y yfcV^f 

- j fl - i « 
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: HUMi2d>bg l * y y f y**¥«i6*s itffg 2 * y 
y fy^sn^-coib^ttEi 7 ©*r y-ys24lc*fffi 

[0 0 5 8] Slt^ h^7Affo*^&18-cm»$;h,fc 

n©jggfE&£fr5„ fcfc*u twjt©*ff*^ai«t* 

[0059] 014 (a) &@B*©$ 

OO^O^B, , B, . B, <DZWetl<?>m&&&to 
»«rfl!VvC«***U £&&©««tg- . g» , g 
• > g. **§S. TIEOS: [4] (cg^T, H 

fWi©«Mg u, y ) **a-t-s. o^y, n 

lEggffig! , g 2 , g 3 , g« HocDz/n y? B 
. . B 2 , B s , B t (D$>>bfrb&.Bffi%*v<n®.miz. 

[0 0 6 0] 
[3SU] 



I - i 
I 



•3C C4] 



[0061] m&&*&&8frhtiMjisti*.s 

5\CAt)£tlZ 0 5 14, 020^75/ 

^tt**^tt5 0 40 
[0 0 6 2] (S2 ©|SJ&©Jfi?fi) *mW<D% 2 ©&& 

©M4, wm%ZW&®m<n><$>$z<DVs<MZT5:-$rtZ> 

[0063] 015 2 (Dmmommomm 

mW.nm^m-Ty'uy^mxh'O. Bi6tt-t©flHfc 
Ctbe>O0lC*3V^-C, 01 fo5lM40 2 tl^— 
©#**ftLfc. 50 



[oo64] xmwom 2 ©nj£©^fi-m, iisi: 

It, 01 6©^75'7'S 3tSrj-J:5IC, &&ffi«!§jE 

kmcxhz, 

[0065] »«ffifa«iE©fc«)©M«fflfa«Hatt. ft 

fc*a«©*#$*»oTv^#ft» o^yg]4©Ri^ 
MfISicfcv^T 1 ^tt^>e>^«i^^:v^^,(^i^ ^gffl©y-r 
7- 5 y ^ u > vat x n it < tt zirfa~w&mz®W! z * 

^#ft, ft©»^**s«t*)5>i»9^t-<*5^i:-C, 
Wfc©«»te*fo-k*tfsc ^« 
ffi©^-f-7-s: y^w>-v ; ^ < ti3jrt:<^5^t ( i > m 1 

B#0~2 5 5©^ft % 12 8) iCJfi^JJtS^lRjTfe 
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LT\ I< 1 2 8 ©#£-|C(2TlE©5$; [5] U:J:oT, 

St i ^ i 2 8 ©a-a-icttTiEwis; [6] laotss 

[0 0 6 6] 

Io2=Ii + ( S X A „, ) ■••5£ [5] 
[0 0 6 7] 

I.* = Ii - (SX4„ ) -5$ [6] 
[0 0 6 8] iive-o^jo^T^ I <* \X&Wfc<r>W%. 
Ii tt5E©IW«ffi> SJi^Sffi, A„, ti^ftg* 
ffil?fc5„ LfdioT v i£[5] , [6] fi, 0~1© 10 
ffi^O^gffiSIC^LT, &K)ft*{itA.„ Mt£ 

to-£tz'&, K<Dvmm>l 2 8 J;D/h$^£tfi&L£- 
fc-fr, *^i#li§l<^<!:£;ii*-f6„ Hl8fcl< 
1 2 8<D^(D-m^Ltz 0 

[0069] &mm&mn2\vmtii£)xfc, * cs] 

Sfcli [6] (DWmti<* ii, ^tv^wy^i 
5. -t L-T, ±9 1 2 8 fcifiWS 5 a*-t«>H*©iH«*[ 
[0 0 7 0] C©i?IC x *»W©»2©|glfi©7Blftfc 

[0 0 7 1] #3gBJf±«Jhlft?ll UfclHkoXMBlc 

Xfi, ±IE^ 1 ©HJSOJBtgKfc^T, -hfERG B-»H 
Slfi, HS I-»RG«*JcS-t-5l*IW«:ffiiBi-5fc 
fcfcTIE (1) ~ (3) <D£5\zimLXi>&\\ 30 
[0 0 7 2] (1) RGB»>fcM*|tI*rjmiU 
NP(CRGBffi*«#-f5o 

(2) HSttfcaH-S^-J-S uv^ak#«sa*n 

[0 0 7 3] (3) (1) -C»#tfcRGB«Sr*(^ N 
RGB*7-M^?rff»tH1-2>„ o*9, 

«7-* txm i <omi&<DBWitm c-cfcSo 

[0 0 7 4] 

[3§W©3MI] £l±»*|llfclMiUiJ:5fc. #389! 40 

xi> mm?. mm& © ftn&aa 5 t * a . 
[oo7 5] st, *%mff>jJ7-m&!mirmz.£ti 

©ay h?7> hBOT*KJt1-5C£a*-C£5. 

[0 0 7 6] Sfcte, ;^H©#7HMtf!i«frifcfc.fc 
fttf* QW^toT? ?.'f'V<DW&£*W£LrX%il<Dt 50 



2002-140700 
12 

[0 0 7 7] -t LT\ **H©*5-®ill«ai*jfetJ: 
fttf, 852 ©7 y y^iESr^A-f-Sr tJi.tt). =>>-h 
7* h&S3©S£^ i>o0«4*©l5^- 

[HiS0ffi¥&tt9U 

[Ell] *$89J©3& 1 ©f?ife©^l£©»ffc£B©«$£ 

[ia 2] HioiMftSttic*5»t5*9-iiiijya3ao«Eii 

©«Eg&*-f 7p-B, 

[0 3] 3K/ ! sfc*#7-*7 f ^*ttiH+ Sfc«>©B, 
[04] n«Sffi«*-ea»fl:UfcHS iSMSrttfl-t-S 

fc»©m, 

[0 5] HIMSWJKTSflMtLfcHS I2SIU2:S^Att 

[me] ® i ommw\z&v 

©«fife^i-7*ns/^0, 

[0 7] 01O«{ftSflllC43tt5^>f^5 7 7 Vi^& 
S&®g(5©&Jl©?ft;iX©1fEg&*1-7 p -0, 

[08] mi<D?s(1-S.-y?U>>i/$cW!&&^t5tfZ> 

[09] t7 h^9AOsp»ft*KK-t-5fc«)OH, 
[010] !&1©7 y y7*fiS:ttW-f5fc«)OH, 
[011] ff!l©7 y y7*«Oifc**tte*lftWi- 
©0, 

[012] ffffi©H£53:ys;ttmHfc©tt*W9£*f 
0. 

[013] ®2©^y y7m*m\-tZ>1i:#><0®, 

[014] «««»¥atc*sttSiBji^iiB]*«fe*iiiMi- 

-5fcto©0 x 

[015] *38W©fg2©fSi6©^l&©&«!&«©1g$ 
Sr^i-7*o y7 0> 

[016] 01 5 0«Kfcig»C*Jtt5*5-ill«[l«!310 
jSStv©1ft® 5:^1-7 o -0 , 
[017] 01 5©JWM6Sfc:tetta££[t*M§]E©fc 

* © w«w mmm & n en -t- a fc * © 0 , 

[018] 01 TCMAtffffteaSrHa-t-S^rSSrRW 
-f Sfc£>©0, 
[019] ft*©«fH«3ES:*ifeS:ttW-*-Sfc»<0H-e 

[^©UiM] 

3 £jg5fc£8MMB: 

4 /^7-5 uyv&w&mu 

5 fe«S;JS!IE»^S 

6 ffi«^ffij^it 

7 *AS&dMftftft¥Jit 

8 Wttil^t 
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